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HAS A- Ames Research Center. 
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Modeling and simulation are critical to 
comprehensively study complex human-system 
designs 

Many different types of models exist at NASA 

- Human behavioral 

- Human performance 

- Anthropometric, biomechanic, volumetric 

- Information processing 

- Vision, auditory, memory, and other human processes 

- Task network 

- Physical structural (space launch vehicle, aircraft, 
crewstations, CAD/CAEs) 

- Airspace system 

- Weather 

- Airflow and other CFD 

- Physiological 

- Robotics and automation 

- Oxygen and blood flow 

- Scheduling 


/\ Human Systems 

^"TJASAAmes Human Modeling in System Design""" 



• Airspace 

• Aircraft Trajectories 

• Illumination 

• Gravitational forces 


ACES: National Airspace 
System 

FACET: Air traffic 
management 


System and 
Environment 
Design 


Physical 

Equipment 

Design 




• Crewstation 

• Flight deck layout 

* Loads JACK: Anthropometric 

• Manual handling 


• Fluids and heat 
'ansfer models 


model 

Biomechanic model 
MIDAS-FAST (& BORIS): 
Robotics Trainer 
Volumetric 
CFD 


BRAHMS: Agent-based 
models 

MIDAS: Behavior models 
Cognitive process models: 
Decisions / response to 
information 

SPIFe/SCORE: Scheduling 
and Planning models 
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• Procedures 

• Training 

• Roles & 
responsibilities 

• Scheduling 
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Operations 

Design, 

Evaluation, 

and 

Integration 


Technology 

Design, 

Evaluation, 

and 

Integration 


' Displays 

• Automation 

• Information 
Requirements 


ADEPT: Human- 
Automation Interaction 
HOP: Human Vision 
Basic Process Models: 
Audition (e.g. threshold 
models), 

MIDAS: Memory & 
cognitive processing 



NASA Ames HSI Research Areas 


http://humansystems.arc.nasa.gov/techareas/tech_areas.php 


Technical Area 

Laboratory 

Research Area 

Human Computer Interaction 
(HCI) 

HCI 

Contribute to the development of better NASA software through careful 
application of iterative user research, interaction design, and usability 


Human Automation Interaction 

ADEPT provides a tool for prototyping automation and associated interfaces, in 
an integrated tool that includes analyses to identify potential HAI vulnerabilities 
early in the design process 


Scheduling and Planning 

Scheduling and Planning Interface for Exploration (SPIFe) toolkit for space 
missions that includes human constraints on mission operations 

Human Performance Research 

Advanced Controls and Displays 

Research on haptics, speech recognition, visual perception, visual perception in 
space, adaptation to virtual environments, and acoustics 


Human Cognition 

The mission of the Cognition Lab is to develop computational models for 
assessing throughput and error rates of human performance. 


Flight Cognition Lab 

Studies the cognitive, team and organizational processes that underlie the 
performance of pilots, air traffic controllers, and other skilled professionals 


Intelligent Systems 

Enhance mission safety and crew efficiency in next-generation spacecraft by 
evaluating the operational impacts of environmental stressors and by developing 
and testing advanced operations concepts and crew-vehicle interfaces. 


Man-machine Integration Design 
and Analysis System (MIDAS) 

Develop human performance models of human-system interaction to predict 
operator performance along the measures of task performance and times, visual 
attention, workload, situation awareness 

Integration and Training 

Airspace Operations Laboratory 
(AOL) 

Researches roles, responsibilities, and requirements for human operators and 
automation in future air traffic management (ATM) systems using human in the 
loop 


Human Centered Systems 
Laboratory (HCSL) 


Focuses on mission safety and efficiency by developing innovative display 
technologies using both HITL and HPM methodologies 
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Human Performance Models 
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Human Performance Models (HPMs) 
allow system designers the ability to 
model critical events that cannot be 
fully studied with empirical simulations 

Models can be used to provide 
estimates of human-system 
performance when the concepts, 
technologies, or automation are too 
new, difficult, or dangerous for the 
human operator 

Model validity is a paramount concern 
when predictions are generated to 
evaluate candidate NextGen 
operations 
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NAS A- Ames Research Center 


Motivation: 
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NextGen Technology Design, Evaluation, and Integration 
• NextGen Characteristics: 

- More data available to the flight deck 

• e.g., weather, wake, traffic trajectory projections, etc. 

- More precise and closely coordinated operations 

• e.g., self-separation, closely spaced parallel operations, RNAV/RNP 

- More tasks are automated 

• Pilot increasingly placed in a monitoring role 

- Potential for increased workload, decreased situation 

awareness, increased demand for shared attentional resources 


Evaluating NextGen Concepts: 
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- Must consider pilots’ capabilities when designing / evaluating 
NextGen procedures, operations, roles / responsibilities and 
the information requirements 

- Failure to do so will leave the pilots, and thus the entire aviation 
system, vulnerable to error 


system, vuir 

MIDAS 
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and analysis system 
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MIDAS Input 


i 


Tasks and Procedure Lists 
(activities and sub-activities) 


Microsaint Sharp 
ission Models 
Workstation Models 
Anthropometric Models 
Environmental Models 
Dynamic Models 
Flight Profile Models 
Scenario Objects 



MIDAS Processes 


Task Manager 

Schedules 

Actuates/Triqqers 


Comr 

nands 

i 

k 

1 

r 

Res 

ults 



Physical Simulation 

Environmental behavior 
Crewstation behavior 
Model state movement 
Model state actions 
Model state changes 


i 


; Library 

Primitive tasks in hur 

i 

nan model 


Operator Characteristics 
Performance Shaping Factors 
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MIDAS Operator Process Models 

Fitts Law; Perception & Attention (SEEV), 
Multiple Resource Model; Memory, SA, 
Workload; Operator States (fatigue, 
gravitational effects); Timeliness 


MtDAS 


man-machine integration design 
and analysis system 


MIDAS Output 
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CSPO Project Overview 



Human Systems 

integration division 


• Objective 


- Develop valid HPMs of approach and land operations, use these models to 
evaluate candidate NextGen concepts (Closely Space Parallel Operations, 
CSPO), develop guidelines regarding flight deck displays and pilot roles and 
responsibilities 


Develop Current 
Day Model 


RNAV 

Approach and 
Land 
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Extend to 
NextGen 


2 Operational 
scenarios of 
CSPO concepts 



Validate 
Model 



Evaluate impact of 
CSPO 


• Compare CSPO 
workload, 
visual fixations 
to RNAV 
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Gore, B.F., Hooey, B.L., & Foyle, D.C. (BRIMS 2011, March 21-26). 


"What-if" 

Investigations 


Off-Nominals 


• Roles, 

Responsibilities and 
Flight Deck Displays 
( 2011 ) 




Evaluating NextGen Closely Spaced Parallel Operations 
Concepts with Validated Human Performance Models 

Model Development and Validation 

- Develop RNAV model based on task analyses (SME input) 

- Validate model inputs, processes and outputs 

- Extend RNAV model to two CSPO Concepts 

- Evaluate : Pilot-ATC separation responsibility. 

Wake Information Requirements, 

Spacing Management Information Requirements 

- Implications based on: Pilot workload, visual attention 
event/alert detection response times 



MIDAS v 5 , a human performance 
model of the flight deck environment, 
pilots' workflow and cognitive 


processes. 


CSPO 

200' 


CSPO Approach: 200' Ceiling 
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- RNAV scenario + 2 CSPO 
operational scenarios 

- Validated model 

- incuts (Focus groups) 

- processes (Literature) 

- outputs (HITL data) 

- Weather (high wind) 

- RNP Loss 

- FMS Failure 

- Aircraft of runway 

- Pilot-pilot roles 
(Allocation of task, 
monitoring workload) 

- Pilot-ATC roles 
(Conflict detection and 
resolution) 

- Flight deck information 
required to support early 
conflict detection and safe 
response 

- Wake format and location 

- Spacing Automation style 
and format 
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CSPO Findings and Implications * 1 


Flight Deck Requirements for: 

1. ATC-Pilot Roles and responsibilities: ATC vs Pilot responsibility for separation 

2. Alert styles for wake and blunder threats: One-stage vs two-stage alerts 

3. Wake display technology: Format (predicted vs real-time), Location (PFD, Nav Display, or Both) 

4. Spacing management automation: Style (Current vs NextGen), Location (PFD, Nav Display, or Both) 

Evaluating ATC-Pilot Roles and Responsibility: Separation Delegation 

- Compared Current-day (ATC responsible for separation) with NextGen (Pilot responsible for separation) 
Model predicted slightly faster emergency escape maneuvers when Pilot's are responsible (.3 sec), BUT... 


Higher workload when pilots are Less balanced pilot scan when pilots are 

responsible for separation responsible for separation 



PFD NAV OTW 

Hooey, Gore, Mahlstedt, & Foyle, (2012); Gore, Hooey, Mahlstedt, Foyle (in process) 
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Summary 


1 . HPMs such as MIDAS can be used to evaluate: 


- Pilot/ATC roles and responsibilities and function allocation 

- Technology development and integration 

- Error or safety vulnerabilities 

- Procedures and training needs 


2. HPMs such as MIDAS can be applied to other: 


- Phases of flight, (e.g. aviation - arrivals, enroute, departures, taxi and 
their transitions; space - ascent, descent; ISS operations) 

- Flight deck technologies (e.g., SVS/EVS; CDTI; EFBs; MFDs; ) 

- Information requirements manipulations 

- Concept of Operations evaluations 

- Space operations (e.g. ISS and CEV/SLS procedure design and 
evaluation) 


- Human-automation interaction domains 
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